Big Data and Product Architect

Product Strategy & Technology Team

The Big Data and Product Architect at DataDelivers is a strategic and highly visible role responsible for designing and implementing solutions for the integration and ingestion of data into the company's big data ecosystem. They collaborate closely with data engineers, cloud engineers, and data scientists to ensure the development and implementation of optimal solutions aligned with industry standards.

Additionally, the role involves project management responsibilities, including defining and managing project roadmaps, task and resource management, sprint planning, and effective communication and collaboration with cross-functional teams. The Big Data Product Architect embrace Agile methodologies and DevOps strategies to drive product delivery and contribute to the maturity of the Agile team.

Big Data Architecture:

• Take ownership of data solutions from design and architecture perspective.
• Define big data architectural blueprints, prototypes, frameworks, and jumpstart support.
• Oversees the implementation of data solutions by working with onshore and offshore teams to create ETL, batch, real-time, and automated processes.
• Manage AWS landscape of EC2 clusters, Glue Jobs, Athena Tables, S3 data lakes and related services and ensure the data ecosystem's scalability and availability.
• Oversee the implementation of data solutions and ensure compliance with standards.
• Select and integrate Big Data tools and frameworks to provide requested capabilities.
• Act as an SME for the big data ecosystem and stay updated with the latest technology trends.
• Monitor performance, identify improvements, and drive modernization efforts.

Project Management:

• Define and manage project roadmaps aligned with strategic initiatives.
• Manage task and resource management, sprint planning, and team ceremonies.
• Facilitate effective communication, issue escalation, and reporting.
• Influence cross-functional teams and ensure compliance with established procedures.
• Embrace Agile and DevOps strategies, contribute to team maturity and adoption.
• Publish standard processes and reusable templates for project management.

Product / Platform Responsibility:

• Prioritize and manage the product backlog for enhanced user experience and profitability.
• Validate requirements and translate them into technical specifications.
• Ensure visibility, transparency, and clarity of roadmaps and the product backlog.
• Collaborate with DevOps team to ensure deliverable quality meets business objectives.

Qualifications:

• 10 years of deep technology expertise in big data platform architecture and development.
• Proficiency in AWS, Hadoop, Spark, MapReduce, and NoSQL databases.
• Experience in designing solutions using various ingestion/ETL techniques, such as Flume, Glue Jobs, HUDI, Step Functions, AWS Lambda, REST and SOAP APIs, SQS, SES.
• Experience with ETL techniques, big data querying tools, and data ingestion from multiple sources.
• Strong competency in Python, AI, and data science toolkits.
• Familiarity with enterprise CRM and campaign management platforms.
• Experience with UI/UX frameworks like JavaScript, Angular, React JS, and technologies including HTML and CSS are highly desired.
• Proficiency in Agile methodologies and project management.
• Excellent relationship building, organization, and collaboration skills.